Properly Learning Decision Trees in almost Polynomial Time
نویسندگان
چکیده
We give an n O (log log ) -time membership query algorithm for properly and agnostically learning decision trees under the uniform distribution over { ± 1} . Even in realizable setting, previous fastest runtime was , a consequence of classic Ehrenfeucht Haussler. Our shares similarities with practical heuristics trees, which we augment additional ideas to circumvent known lower bounds against these heuristics. To analyze our algorithm, prove new structural result that strengthens theorem O’Donnell, Saks, Schramm, Servedio. While OSSS says every tree has influential variable, show how can be “pruned” so variable resulting is influential.
منابع مشابه
Properly Learning Poisson Binomial Distributions in Almost Polynomial Time
We give an algorithm for properly learning Poisson binomial distributions. A Poisson binomial distribution (PBD) of order n ∈ Z+ is the discrete probability distribution of the sum of n mutually independent Bernoulli random variables. Given Õ(1/ǫ) samples from an unknown PBD P, our algorithm runs in time (1/ǫ) , and outputs a hypothesis PBD that is ǫ-close to P in total variation distance. The ...
متن کاملBuilding PQR trees in almost-linear time
In 1976, Booth and Leuker invented the PQ trees as a compact way of storing and manipulating all the permutations on n elements that keep consecutive the elements in certain given sets C1, C2, . . . , Cm. Such permutations are called valid. This problem finds applications in DNA physical mapping, interval graph recognition, logic circuit optimization and data retrieval, among others. PQ trees c...
متن کاملAlmost-Everywhere Superiority for Quantum Polynomial Time
Simon [Sim97] as extended by Brassard and Høyer [BH97] shows that there are tasks on which polynomial-time quantum machines are exponentially faster than each classical machine infinitely often. The present paper shows that there are tasks on which polynomial-time quantum machines are exponentially faster than each classical machine almost everywhere.
متن کاملLearning Characteristic Decision Trees
Decision trees constructed by ID3-like algorithms suffer from an inability of detecting instances of categories not present in the set of training examples, i.e., they are discriminative representations. Instead, such instances are assigned to one of the classes actually present in the training set, resulting in undesired misclassifications. Two methods of reducing this problem by learning char...
متن کاملLearning fuzzy decision trees
We present a recurrent neural network which learns to suggest the next move during the descent along the branches of a decision tree. More precisely, given a decision instance represented by a node in the decision tree, the network provides the degree of membership of each possible move to the fuzzy set z.Lt;good movez.Gt;. These fuzzy values constitute the core of the probability of selecting ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of the ACM
سال: 2022
ISSN: ['0004-5411', '1557-735X']
DOI: https://doi.org/10.1145/3561047